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ABSTRACT 


During its 1998 deployment the USS INDEPENDENCE (CV 62) and Carrier Air 
Wing Five operated under the control of Commander, Task Force 50 (CTF-50). To 
balance resources and readiness, CTF-50 asked the following question: “How many days 
can the USS INDEPENDENCE go without “off ship” logistics support before the number 
of Mission Capable aircraft can be expected to fall below Chief of Naval Operations 
readiness goals?” This thesis develops a Markov chain model to answer this question. 
Explanatory variables for this model include sorties flown, cannibalization rate and 
frequency of “off ship” logistics support. Using data from INDEPENDENCE, this thesis 
analyzes aviation readiness by estimating the number of F/A-18 aircraft capable of 
performing at least one of its intended missions. 

Both non-linear Markov models and Generalized Linear Models are employed to 
estimate the effect of the operating environment on the number of mission capable 
aircraft available. The analysis demonstrates how the Markov approach captures the 
cyclic nature of aircraft operations and maintenance. Specifically, it is shown that 
INDEPENDENCE can expect to operate five to eight days without “off ship” logistics 
support before F/A-18 MC rates fall below CNO readiness goals. Recommendations for 

t 

further studies are included. 
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EXECUTIVE SUMMARY 


Keeping a carrier air wing “Mission Capable” requires' a complex integrated 
logistics support system composed of various functions which include both supply and 
maintenance support elements. While most aircraft can be repaired without “off ship” 
assistance, occasionally components fail and the maintenance organization is unable to 
repair the aircraft because it lacks the appropriate onboard spare. In these cases, the 
material is requisitioned from an “off ship” source and shipped to a shore based logistics 
site located near the operating area of the carrier. The material is then delivered to the 
ship through a process known as Carrier Onboard Delivery (COD).. 

USS INDEPENDENCE (CV 62) and Carrier Air Wing Five operated under the 
control of Commander, Task Force 50 (CTF- 50) during its 1998 deployment to the 
Persian Gulf. In an effort to balance operational tempo with available resources, CTF-50 
hypothesized that reducing the frequency of COD flights, would result in achieving 
resource conservation. At the same time, reducing the number of CODs would have an 
adverse impact on the air-strike readiness. Without CODs, the maintenance communities 
will have to wait longer for critical “off ship” requisitions. To balance resources and 
readiness, CTF-50 asked the following question: How many days can INDEPENDENCE 
go without a COD before the number of available Mission Capable (MC) / Full Mission 
Capable (FMC) aircraft can be expected to fall below Chief of Naval Operations (CNO) 
readiness goals? CTF-50 and INDEPENDENCE asked the Naval Postgraduate School 
(NPS) to provide assistance in analyzing the effect of changes in the frequency of COD 
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service on carrier based aircraft readiness. This thesis develops a non-linear model based 
on a modified Markov chain to support its findings. 

The Markov approach finds a significant link between the frequency of COD 
service and cannibalization opportunity and the rate at which aircraft are repaired. 
Additionally, it shows a significant link between aircraft utilization rate and the rate an 
aircraft fails. Finally, the model estimates that INDEPENDENCE can expect to go five to 
eight days without “off ship” logistics support before aircraft readiness falls below the 
CNO goal. 

While the model includes a term to capture cannibalization, its effect is not as 
large as expected. That is, cannibalization did not significantly reduce the effect of a 
long-term COD deprivation. The effect modeled here can most likely be attributed to 
increased pressure on maintenance personnel to maintain MC rates above CNO goals as 
the number of NMC aircraft increases. In a wartime scenario, or a period where a 
prolonged outage of “off ship” logistic support is anticipated, cannibalizations would 
increase and maintenance personnel would be more aggressive in the repair effort, which 
would likely extend the number of days readiness rates would remain above CNO goals. 

Areas for further research include refinement of the data collection to provide 
better model predictions, simulation of the Markov model to improve the estimates of 
carrier based aviation readiness during a prolonged deprivation of “off ship” logistics 
support, and application of the Markov model to a second deployed carrier to demonstrate 
the portability of the Markov approach. 
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X. INTRODUCTION 

Keeping a carrier air wing “Mission Capable” requires a complex integrated 
logistics support system composed of various functions which include both supply 
support and maintenance support. These logistics support functions can be classified as 
either “on ship” or “off ship” elements. “On ship” elements include organizational 
maintenance personnel, Aviation Intermediate Maintenance Department (AIMD) and an 
extensive inventory of spares, tools and test equipment. “Off ship” elements include 
depot level maintenance activities, stock points, and transportation assets. 

Because carriers operate forward deployed, the carrier air wing must be able to 
operate for extended periods of time without support from shore based activities. While 
most aircraft can be repaired without “off ship” support, there are times when 
components fail, and the maintenance organization is unable to repair the aircraft because 
it lacks an appropriate onboard spare. In these cases, the material is requisitioned from 
“off ship” logistics activities and shipped to a shore based logistics site located near the 
operating area of the carrier. The material is then delivered to the ship through a process 
known as Carrier Onboard Delivery (COD). 

A. BACKGROUND 

USS INDEPENDENCE (CV 62) and Carrier Air Wing Five operated under the 
control of Commander, Task Force 50 (CTF- 50) during its 1998 deployment to the ' 
Persian Gulf. In an effort to balance operational tempo with available resources, CTF-50 
hypothesized that reducing the frequency of COD flights, would result in achieving 
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resource conservation. At the same time, reducing the number of CODs would have an 
adverse impact on the air-strike readiness. Without CODs, the maintenance communities 
will have to wait longer for critical “off ship” requisitions. To balance resources and 
readiness, CTF-50 asked the following question: How many days can INDEPENDENCE 
go without a COD before the number of available Mission Capable (MC) / Full Mission 
Capable (FMC) aircraft can be expected to fall below Chief of Naval Operations (CNO) 
readiness goals of 78% MC and 61% FMC, OPNAVINST 4790.2F (1995). 

One measure of an Air Wing’s overall readiness is indicated by its Mission 
Capable (MC) Rate. MC is defined as the sum of Partial Mission Capable (PMC) and 
Full Mission Capable (FMC) aircraft. In simple terms, an aircraft is considered Full 
Mission Capable (FMC) if it can perform all of its intended missions and Partial Mission 
Capable (PMC) if it can perform at least one of its intended missions. The rate is the 
percentage of aircraft onboard that are MC. When an aircraft is neither PMC nor FMC it 
is defined to be Not Mission Capable (NMC). This thesis uses changes in the estimated 
MC rates to judge the effect of changes in “off ship” logistics support on aircraft 
readiness. 

B. RESEARCH METHODOLOGY 

Identifying potential variables and collecting appropriate data is the first step in 
determining the potential impact of a loss of “off ship” logistics support on MC/FMC 
rates. Working closely with INDEPENDENCE, over 180 observable operational and 
support characteristics were identified and recorded. Operational characteristics included 
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items such as MC/FMC counts and rates, flying hours, sorties flown, date of last COD, 
and scheduled date of next COD. The support characteristics include supply 
effectiveness, range and depth of repair parts, and the number of components “awaiting 
repair due to parts” (AWP). The data consists of observations collected onboard 
INDEPENDENCE while operating in the Persian Gulf from February 1998 to June 1998. 
Observations were recorded in a Microsoft Excel spreadsheet and electronically 
transmitted to NPS for analysis. 

There are several potential methods available for predicting MC rates. One 
approach is to use classic regression where the number of MC aircraft is modeled as a 
function of several explanatory variables, each representing some aspect of the operating 
environment. This is the approach that most of the previous analysis efforts use. For 
example, Makcel (1987) deals in detail with “logit regression” modeling of aircraft 
MC/FMC rates. More recently, a set of studies on aircraft readiness were performed by 
the Center for Naval Analyses (CNA) and is given in Francis and Oi (1998), and two 
works by Junor, et al. (1997, 1998). All three works deal with forecasting monthly 
MC/FMC rates for all Navy-wide fighter and attack aircraft. Francis and Oi (1998) 
examine the volatility observed in MC/FMC rates concluding that the observed variance 
is not unlike that observed in some economic time series. Junor (1997, 1998) looks at the 
use of classic regression model for forecasting aircraft readiness. Moore (1998) extends 
Junor to Generalized Linear Models and Tree Diagrams. Both Junor and Moore conclude 
that the significant explanatory variables found using classic regression techniques are 
helpful in predicting the effect their policy changes may have on long-term aviation 
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readiness. However, they also conclude their usefulness in forecasting month to month 
aviation readiness is limited. 

During the course of a deployment, aircraft cycle between MC and NMC. Junor 
(1997) proposes modeling these cycles with a modified Markov chain. In a Markov chain 
the movement from one state to another is governed by transition probabilities. Junor 
was able to model the behavior of FMC rates by making the transition probabilities 
dependent on measures of personnel readiness, sorties flown per aircraft and supply 
support. 

This thesis uses a combination of both linear and non-linear models in examining 
operational and logistics support environment on readiness. A linear Markov model with 
stationary (constant) transition probabilities is used to confirm that the Markov modeling 
approach is sensible. Then, a sequence of non-linear Markov models with variable 
transition probabilities are fit which lead to the selection of the Markov model used in the 
analysis portion of this thesis. Finally, a sequence of Generalized Linear Models (GLM) 
is used as a reference to evaluate the performance of the Markov models. Empirical 
findings indicate that the Markov models fit and provide forecasts that are significantly 
better than the GLM. 

C. SCOPE AND LIMITATIONS 

This thesis is limited to the study of carrier based aviation readiness for 
INDEPENDENCE’S 1998 deployment to the Persian Gulf. The work focuses on the 33 
F/A-18 fighter attack aircraft assigned to the INDEPENDENCE to validate the Markov 
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model approach. F/A-18’s were chosen because they comprise a significant portion of 
the embarked aircraft and make up over 50% of the Air Wing’s strike capability. 

Current reporting requirements concentrate on aggregate counts by squadron. 
That is, the data collected consists of aggregate counts of MC/FMC aircraft by aircraft 
type (i.e., F/A-18, F-14, etc). Additionally, support characteristics like range and depth 
of spare parts on board and the number of “off ship” requisitions are aggregate measures 
without regard for aircraft type. For this thesis, it was decided early in the process to use 
aggregate measures to build a forecasting model in order to be consistent with current 
reporting practices. 

One of the goals of this thesis is to provide forecasts for the number of aircraft an 
operational commander can expect to launch in support of operations. The number of 
MC aircraft was chosen because it meets this goal and simplifies the model significantly. 
Even if the model were modified to predict the numbers of FMC and PMC aircraft 
separately, the model would not be able to predict the capabilities individual PMC aircraft 
may have. Additionally, it is reasonable to assume that the onboard mission planners 
could support strike requirements generated from the estimate of the MC count by 
matching the specific capabilities of individual PMC to roles in the mission. 

D. THESIS ORGANIZATION 

This thesis is organized along the general lines of the model development. This 
involves three basic steps: (1) specifying plausible equations and probability distributions 
(models) to describe the main features of the underlying process that govern the MC 
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rates; (2) using the data to estimate parameters (coefficients) for models and deciding 
which is the most plausible and best fitting; and (3) using the resulting fitted model to 
forecast MC rates under a variety of conditions. 

Chapter II develops the use of Markov chain models in a readiness application. 
First, a simple Markov chain model is developed without explanatory variables to 
establish the underlying concepts and the approach’s intuitive appeal. Then, a section is 
dedicated to methods for incorporating explanatory variables into the model. 

Chapter HI discusses the fitting of a sequence of Non-linear Markov models and a 
family of Generalized Linear Models (GLM) to estimate the effect of changes in the 
frequency of COD service on the expected number of MC aircraft. Empirical results 
observed during the fitting process are presented and a comparison of Markov models and 
GLM is discussed. 

Chapter IV uses the Markov model built in Chapter HI to estimate the effects of 
different operating and support environment on MC counts. The Markov model is also 
used to forecast aircraft readiness during a prolonged absence of “off ship” logistics 
support. 

Chapter V presents conclusions and recommendations, and identifies areas for 
further research. 
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II. MODEL DESCRIPTION 


The first step in forecasting the number of days INDEPENDENCE can go without 
COD service before MC rate falls below the CNO goal is to model the number of Mission 
Capable (FMC and PMC) aircraft on a particular day as a function of the number of MC 
aircraft on the previous day along with any other explanatory variables which capture the 
current operating conditions on the ship. These explanatory variables can include sorties 
flown (SF), “off ship” logistics support, or range and depth of onboard repair parts. 

One approach is to use classic regression where the number of MC aircraft is the 
response variable and the number of MC aircraft for the previous day, number of sorties 
flown, etc. are explanatory variables. This approach, however, fails to capture the 
structure of the underlying process. This chapter explains how the use of a modified 
Markov chain can add realism to the model that is absent in classic regression. This 
model was first proposed by Junor, et al. (1997) in a similar study, which sought to 
forecast Navy-wide readiness for fighter and attack aircraft on a month to month basis. 

A. CONCEPTUAL MODEL 

At the beginning of the flying day or 1200 local, whichever occurs first, the 
number of MC aircraft is determined and reported. In the simplest terms, the material 
condition of an aircraft can be defined by one of two qualitative states, MC or NMC. 
Thus, the material condition of an individual aircraft can be modeled as a binary random 
variable, i.e., it assumes the value of one if the aircraft is MC or zero if the aircraft is 
NMC. 
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For simplicity consider that at noon each day technicians observe a series of 
Bernoulli trials (coin flips) which determine the state of each aircraft. For the aircraft that 
started the operating period in a MC state there is a probability. Pi, that the coin will turn 
up heads, meaning the aircraft will remain MC (a success), and a corresponding 
probability (1-Pi) that the aircraft will fail and transition from MC to NMC. Similarly a 
probability P 2 can be used to govern the “successful” repair of an NMC aircraft, meaning 
it transitions from NMC to MC. After testing each plane, the technicians report the 
number of successful trials, which translates to the number of MC planes onboard. 

The simplest Markov model assumes that the probability an aircraft remains MC 
is Pi and the probability an NMC aircraft transitions to MC is P 2 , and both are constant. 
In other words, the technician uses the same coin each day. By considering operational or 
support factors, one can envision a model in which Pi or P 2 could be adjusted to capture 
the environment the aircraft operated in during the previous period. For example, if the 
number of sorties flown today was high. Pi could be adjusted down; this makes it more 
likely that an aircraft would fail and transition to the NMC state during the period. 

B. MARKOV MODEL BASICS 

Let MC t be the number of MC aircraft at time t, where t represents an integer 
number of days, and let N be the number of aircraft onboard. Since the 
INDEPENDENCE deploys with a fixed number of aircraft, N is constant. Then, {MC t , t 
= 0,1,2,...} is a stochastic process which takes on the possible values {0,1,2,...,N}. If 
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MC, = i, then the process is said to be in state i at time t. Suppose that whenever the 
process is in state i, there is a fixed probability Py that the next state will be j with 

Pj j = P[MC t+1 = j I MC, = i]. (1) 


Such a stochastic process is called a Markov chain. One benefit of using a Markov chain 
for this application is the distribution of any future state MC t+ i depends only on the 
present state MC t . (Ross, 1993) 

Since probabilities Py are non-negative and the process has to transition into some 
state it follows that 


AT 


P L j > 0, i, j> 0 and P. . =1, i = 0,1,2,.. JV. 

>o 

Now let P denote the matrix of one step transition probabilities, such that 


( 2 ) 


P = 


0,0 


^0 

Puo P\,2 


P p 

r N, 0 • r JV,l 


1 0,N 


■ N.N 


(3) 


For example, consider the four-state Markov chain depicted in Figure 1 with N = 3 
aircraft. When MC t is 1, there is one MC aircraft and two NMC aircraft. There are two 
possible manners in which the process can get from state 1 to state 2, either, repair one of 
the two NCM aircraft while the one MC aircraft remains MC, or repair both NCM aircraft 
while the MC aircraft fails and transitions from MC to NMC. It is evident how quickly 
the number of calculations required to compute individual Py increase as the number of 
aircraft is increased. In this thesis, the 33 F/A-18 aircraft assigned to INDEPENDENCE 
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are considered. The result is a 34 by 34 matrix P where each row defines the conditional 
distribution for MC, +] given MC t = i. 



Figure 1: Transition Paths from State 1 to State 2 


Because the Markov chain described here is irreducible and ergodic, there exist 
limiting probabilities, denoted flj, that the process will be in state j = 0,1,2,...,N at some 
future time. The Flj are independent of the starting state i and can be shown to equal the 
long run proportion of time the process will be in state j. These limiting probabilities 
define the unconditional distribution of MC t . (Ross, 1993) 

From an operational standpoint, commanders are interested in short-term forecasts 
for the expected number of MC aircraft available. In the long-term, policy makers are 
interested in estimating the impact policy changes will have on overall aircraft readiness. 
These Markov models allow the examination of both short-term and the long-term effects 
of changes in operational or logistics support factors on aircraft readiness. 


10 











C. BASIC MARKOV MODEL 

This section develops a Markov approach to modeling aircraft readiness and 
demonstrates how this approach accounts for the observed behavior of the actual data. 
Aircraft readiness can be modeled directly as a Markov process by generating a P matrix 
consisting of Py’s which are functions of Pi and P 2 . Rather than focus on these transition 
probabilities for this model, it is simpler to describe the model in terms of the expected 
values. Concentrating on the expected values has the additional advantage that it is more 
readily interpretable for operators. The work in this section follows Junor (1997). 

Given MC t for day t, the number of MC aircraft for the next day MC t+ i is a 

random variable, which is the sum of two Binomial random variables. Let X t+ i represent 

the number of aircraft that started the period t in an MC state and remained that way- (i.e., 

did not break), and let Y t+ i, represent the number of aircraft that transition from NMC to 

MC during time t (i.e., are repaired). Given MC t , X, + i is modeled as a Binomial random 

variable with MC t trials and probability Pi and Y t+ i is modeled as a Binomial random 

variable with N-MC t trials and probability P 2 . This model assumes that the outcome for 

each aircraft is independent of the outcome for any other aircraft on a given day. In 

addition, if the repair for NMC aircraft is independent of the event that an MC aircraft 

remains MC, X t+ i and Y t+ i, conditioned on MC t , can also be modeled as independent. 

/ 

The relationship between the variables is expressed as 
• . MC J+ , = Y t+i + X, +1 , (4) , 
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where X t+ i given MC t is Binomial(MC t , Pi) and Y t+ i given MC, is Binomial(N-MC t , P 2 ). 
Then the expected value of MC t+ i, given MC t is 

E[MC l+] \MC,] = P l * MC t +P 2 *(N- MC,). (5) 


Equation (5) gives the mean of the conditional distribution for MC t+ i, which is 
used to forecast for the number of MC aircraft in the next period. While this value is 
important to planners in the short term, the mean of the unconditional distribution for 
MC, will provide more insight into the effect that changes in Pi and P 2 have on long-term 
MC rates. The unconditional mean represents the stationary or equilibrium value about 
which the process would vary regardless of the starting point. Let MC SS represent the 
mean of the random variable MC,. Then by defining MC SS = E[MC,+i] = E[MC t+2 ]... and 
substituting. Equation (5) can be manipulated to read 


MC„ = •-- 


l-P ]+ P 2 


( 6 ) 


Of course the conditional distribution at a given t may be quite different than the mean of 
the unconditional steady state distribution, but this is perfectly consistent with a process 
being stationary (Chatfield, 1975). This unconditional steady state mean is used to 
evaluate long-term impact of changes on aircraft readiness. 


D. SERIAL CORRELATION 

Observations of a random variable recorded with respect to time are called a time, 
series. For example, MC, is a time series. One phenomenon frequently observed in time 
series random variables is known as serial correlation. That is the tendency of 
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observations to run on one side of the mean or the other. Serial correlation, however, is 
not limited to successive observations of a random variable. Monthly retail sales figures, 
for example, often exhibit correlation in a seasonal pattern with period twelve. The 
number of periods between correlated observations is referred to as the lag. Serial 
correlation presents a problem for classic regression models as the observations of a 
random variable are assumed to be independent. (Hamilton, 1992) 

Autocorrelation is a measure of the serial correlation present in a time series. 
Figure 2 is an autocorrelation plot of F/A-18 and F-14 MC counts observed by 
INDEPENDENCE. The autocorrelation function of S-Plus provides an estimate of the 
amount of correlation between observations of a random variable at various lags. The 
horizontal band about zero provides an interval such that falling outside implies rejecting 
the null hypothesis (at the 5% level) that the true autocorrelation is zero in a two tailed 
test. The plots indicate that serial correlation is present in both F/A-18 and F-14 MC 
counts. 


Series: FI 8 



Figure 2: Autocorrelation Plot of F/A 18 and F-14 MC Counts 
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Although autocorrelation presents a problem in classic regression, time series 
regression accounts for autocorrelation by including lagged values of the dependent 
variable as an explanatory variable. Starting with Equation (5) define a = P 2 -P x . Then 

E[M C t+I \MC t ] = MC SS - a (MC t - MC SS ), (7) 

where Equation (4) is in the form of a first order autoregressive process denoted AR(1), 
which is sometimes referred to as the Markov process (Chatfield, 1996). 

Three consequences of the Markov modeling approach are now apparent: (1) a 
link has been established between the actual underlying process governing aircraft MC 
rates and a Markov chain; (2) estimates of the probabilities Pi and P 2 can be obtained 
using Equation (5) as a regression equation; and (3) the model accounts for the 
autocorrelation observed in actual MC counts in a way classic regression cannot. 

E. INCORPORATING EXPLANATORY VARIABLES 

The Markov model introduced in Section C does not account for changes in the 
operational environment. These changes such as frequency of COD service, number of 
sorties flown etc., affect the entering and exiting probabilities Pi and P 2 . The expected 
value of MC t+ i is a function of the entering and exiting probabilities. Pi and P 2 . Rather 
than modeling the expected number of MC, +] as a direct function of the explanatory 
variables, we will treat Pi and P 2 as functions of the explanatory variables. 

The form of the relationship between Pi, P 2 and the explanatory variables must 
consider that Pi and P 2 are probabilities. Probabilities can only range between zero and 
one. A simple linear relationship would allow Pi or P 2 to take on values outside this 
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range. To overcome this problem, a more complicated non-linear (logistic) relationship is 
chosen. Specifically, let xj, X2,..., x p represent p explanatory variables such as, sorties 
flown, “off ship” logistic support, flight hours, etc. Then 


e Po+P\ X l+"'+PpXp 

+ 311(1 

+'"+tpX p 

p - _£- 

2 ^ ^ 


( 8 ) 

( 9 ). 


where po, P p and <|)o, ..., 4>i are parameters or coefficients of the explanatory variables 
and 0 < Pi,P 2 < 1 for all possible values of the explanatory variables. Note that intercepts 
(Po> <l>o) are included to allow Pi or P 2 to equal a value other than 0.5 in cases where all the 
explanatory variables included in the function for a particular transition probability are 
zero. 

In classic regression, the dependent variable, in this case MC t+ i, is modeled using 
a single linear combination consisting of coefficients and explanatory variables, which . 
weigh the effect of operational and/or support characteristics to produce forecasts. In the 
Markov approach, which combines Equations (3), (8) and (9), the dependent variable is 
modeled as the sum of two distinct functions that include linear combinations of the 
explanatory variables. This allows the impact of a single operational or support element, 
to affect either the failure rate or repair rate of aircraft. It also introduces greater realism 
to the model that classic regression techniques are unable to provide. 
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III. FITTING MARKOV CHAIN MODELS 


Chapter II develops the general form of the equations used in Markov models and 
explains how these equations capture the main features of the underlying process. This 
chapter describes how the data collected onboard INDEPENDENCE is used to estimate 
or fit the parameters (coefficients) for the Markov models. 

Additionally, a family of Generalized Linear Models (GLM) is fit to serve as a 
baseline for the Markov models. Empirical results observed during the fitting process are 
presented and a comparison of Markov models and GLM is discussed. 

A. ESTIMATION DETAILS 

The equation for the Markov model with explanatory variables developed in 
Chapter II is non-linear in the parameters. The parameters for these non-linear models are 
estimated using the non-linear least-squares (nls) function provided with the statistical 
software package S-Plus. The nls algorithm uses iterative Gauss-Newton approach to 
find the parameter estimates that minimize the residual sum of squares (RSS). Detailed 
information on the nls algorithm is available in the S-PLUS Guide to Statistics (1997). 

B. MODEL SELECTION CRITERION 

The fit of competing models is evaluated by comparing the residual standard error 

(RSE) of each model: 

RSE=1^-, (10) 

V n — K 
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where n is the sample size, K is the number of estimated parameters and RSS is the 
residual sum of squares. The residual standard error measures the scatter or spread of the 
data around a regression line - hence the goodness of fit (e.g., Hamilton (1992)). 
Additionally, RSE provides a measuring stick to judge the improvement in fit made by 
adding more parameters to a model. 

In classic linear regression where the dependent variables are normally distributed, 
exact tests and confidence intervals are available to check the significance of individual 
parameters. Low significance implies that the particular explanatory variable has little or 
no predictive value in the model and therefore should be removed. 

In the case of non-linear models or cases where the dependent variables are not 
normally distributed, approximate tests or confidence intervals are used to check the 
significance of individual parameters. As recommended by Venables and Ripley (1994), 
the “profile t” function in S-Plus is used to compute an approximate 90% confidence 
interval for each parameter estimate in the non-linear model. Confidence intervals that 
include zero imply that zero is a plausible value for the parameter and the explanatory 
variable should be eliminated from the model. Further details of the “profile t” function 
and the associated function to generate confidence intervals are available in S-Plus 4 
Guide to Statistics (1997). 

C. THE FITTING PROCESS 

I " ’ 

As a starting point, MC t+ i given MC, is modeled as a function of MC t with 
parameters Pj and P 2 : 
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E[MC t+l I MC, ] = P, * MC, + P 2 *(N - MC ,). (11) 

Since this equation is linear, the parameters can be estimated using standard linear 
regression techniques. This model is chosen as a starting point to generate initial values 
for the intercepts of the more complicated non-linear models that follow. Close initial 
estimates for parameter in non-linear models improve the prospects for a successful fit. 
The initial estimates for the intercepts can be found by solving for po and <t>o in Equations 
(8) and (9), respectively. 

Since Pi and P 2 are constant in this model a single Py matrix describes the 
conditional distributions for MC,+i given MC t . Following the idea of a goodness-of-fit- 
test the model’s conditional distribution can be compared with a discrete conditional 
distribution estimated empirically from the observed MC counts. From the 
INDEPENDENCE the proportion of observations for MC t +i given MC t is 28 and MC t+ i 
given MC t is 29 are determined empirically. The given states (MC t of 28 or 29) are 
selected to provide a sample of sufficient size to present results. Figure 3 shows the 
conditional distributions estimated from the Markov model with small circles and the 
observed proportions with horizontal lines. The shape of the observed proportions 
matches the shape of the conditional distribution of the Markov model. 

Notice the shape of the observed data does not exhibit the variance predicted by 
the Markov model. The Markov model is the sum of the two Binomials. The variance 

i 

of the sum of two Binomial random variables is the sum of the variances of the 
individual Binomial random variables (Larson, 1994) and is given by 
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VAR[MC t+i \MC t ] = MC,*P l (l-P ] ) + (N-MC,)*P 2 (l-P 2 ). (12) 

Using Equation (12), the estimated variance for MC t+] given MC t is 28 and MC t+] given 
MC t is 29 are 3.13 and 3.12, respectively. The observed variances are 1.16 and 1.67, 
based on 10 and 21 observations. This condition of observing a variance smaller than 
the estimate is called underdispersion and is not often found in practice. For the 
purposes of forecasting, underdispersion does not represent a problem for the predicted 
•values, but.it does mean that standard methods for calculating prediction intervals and 
confidence intervals will be conservative (too wide). 


Observed Counts [MC(t+1)IMC(t)] 



MC(t+1) 


Observed Counts [MC(t+1)!MC(t)] 



MC(t+1) 


Figure 3: Conditional Distributions for the Markov Model 
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1. Stationary Transition Probabilities 

Having fit a Markov model with a linear form. The linear parameters Pi and P 2 in 
Equation (11) are replaced with the non-linear functions for Pi and P 2 , Equations (8) and 
(9) respectively. This model estimates P x and P 2 for Pi and P 2 as functions of po and <|>o. 
Here, P l is 92.60%, which is reasonable for the probability that an aircraft remains MC. 

However, P 2 is 58.04%, which is higher than expected. 

The summary of the model fit is presented in Table 1. A generalized likelihood 
ratio test is used to test the null hypothesis: E[MC t+ il MC t ] is constant against the 
Markov model. The generalized ratio test gives a p-value of 0.0000 (The test statistic is 
30.36 which under the null hypothesis has an approximate % 2 with one degree of freedom 
distribution). Thus, we reject the null hypothesis and conclude the Markov model 
significantly improves the fit. 


Variable Name 

Parameter 

Standard 

90% Cl 


Estimate 

Error 

LL 

UL 

Po (Pi Intercept) 

2.5280 

0.1886 

2.2450 

2.8955 

<t>o(P 2 , Intercept) 

0.3233 ' 

0.4166 

-0.3611 

1.0972 

Residual Sum of 

78.9952 




Squares (RSS) 
Residual Standard 

1.0623 




Error (RSE) 


/ 



Degrees of 
Freedom (n-k) 

70 





Table 1: Markov Model with Stationary Transition Probabilities 
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A 

Notice the confidence interval for intercept term, , includes zero, indicating the 

actual parameter may be zero. It was found that including an intercept term, <(>o, in the 
function for P 2 did not significantly improve the fit of the more complicated linear 
models that follow. Therefore, the remaining models described do not include an 
intercept term in the function for P 2 . 

2. "Off Ship" Logistic or COD Support 

As mentioned in Chapter 1, the goal of the thesis is to examine the impact of “off 
ship” logistics support on the MC rates for F/A-18 aircraft. It is a logical assumption that 
the availability of COD support affects the probability of repair, P 2 . Several explanatory 
variables are used in trying to measure the impact of COD support. Most consist of some 
type of counter. Two are explained below. 

f ‘ 

The variable “logdays” attempts to capture the quantity of material that may be on 
a particular COD in terms of “days of material”. Material flows into theater of operation 
each day the carrier is deployed. This material is staged for the next COD flight to the 
ship. The value of “logdays” is zero (i.e, no “off ship” logistics support) for any day 
without COD service. For each day a COD flight occurs it is assumed all material staged 
for the ship is sent to the ship. Therefore it is reasonable to represent the quantity of 
material on the COD by the number of days of logistics support backed up ashore. For 
example, “logdays t ” is one if there was a COD flight yesterday and two if the last flight 
was two days ago and so on. 


22 



A second variable, called simply “cod t ” is used to model the number of days since 
the last COD arrived onboard. When the ship receives a COD, the explanatory variable 
“cod,” is zero. The value of “cod,” is increased by one for each day without COD service. 

Three models are fit with these two variables; one model with each explanatory 
variable by itself, and a third with both. The model with the variable “cod,” included in 
the function for P 2 with parameter 4>i fits the best. The model summary for the best model 
is provided in Table 2. 


Variable Name 

Parameter 

Estimate 

Standard 

Error 

90% Cl 

LL UL 

Po (Pi Intercept) 

2.7464 

0.0721 

2.6268 

2.8873 

<j>i (P 2 , codd 

-0.6811 

0.3188 • 

-1.3290 

-0.2359 

Residual Sum of 
Squares 

Residual Standard 
Error 

72.2807 

1.00195 




Degrees of 
Freedom 

72 





Table 2: Markov Model with COD support 


As mentioned earlier, the status of aircraft is determined at the start of the flying 
day or 1200 local. The COD often arrives well after the start of flight operations. From 
discussions with the Aviation Supply Officer onboard INDEPENDENCE, MC rates may 
not be accurate. This is due to the fact that if a part is scheduled to arrive on today’s 
COD, the maintenance organization may actually classify a NMC plane as MC, 
anticipating a quick turnaround from the receipt of the part to returning the plane to a MC 
status. This practice was not a fixed policy on the ship and was determined on a case by 
case basis onboard. Since no records were kept of which days early credit for repair 
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actions was taken, the model was fit with both cod, and cod t+i , and it was found that the 
unlagged value, a COD today affects tomorrow’s MC rate, was the better predictor. 
However, since daily COD support is the norm, there is little difference in the sequence 
of observed values and how they affect the fit of the model. It is recommended that 
future models check both lags during the model building process. 

3. Aircraft Utilization Rate 

The probability of an MC aircraft being MC at the end of the operating period (24 
hours) changes with the utilization rate for the aircraft. Utilization rate is a general term 
to denote the service conditions the aircraft was exposed to in the previous 24 hours. The 
two obvious choices for incorporating this effect of aircraft utilization are sorties flown 
(SF) and flight hours (FH). A sortie is one flying cycle for the aircraft and involves a 
takeoff and landing, both of which can be classified as shock events. It is assumed that 
the more takeoff and landings an aircraft is exposed to the more likely it is to fail. Many 
of the systems onboard an aircraft are only used when the aircraft is flying. It is assumed 
that failures occur either when the systems are started before flight operations or when the 
aircraft is flying. The longer the system is in use, the more likely it is to experience a 
failure. Two explanatory variables are defined, SF per MC aircraft and FH per MC 
aircraft. They are denoted SF, and FH t , respectively. 

/ 

Overall it was found that models with SF,+i preformed better than those including 
FH,+i. A model including both SF, + i and FH,+i did not perform well due to the high 
correlation between the variables. Another model with a random variable equal to the 
sum of SF,+i and FHt+i was fit in an effort to overcome the high correlation observed in 
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the two explanatory variables. However, this model did not significantly improve the fit. 
A summary of the fit is provided in Table 3. 


Variable Name 

Parameter 

Standard 

90% Cl 


Estimate 

Error 

LL 

UL 

Po (Pi Intercept) 

2.9746 

0.2143 

2.6558 

3.3924 

Pi (Pi SF*,) 

-0.1712 

0.1430 

-0.4385 

0.0527 

(P 2 , codt) 

-0.6996 

0.3233 

-1.3803 

-0.2551 

Residual Sum of 

70.6477 




Squares (RSS) 
Residual Standard 

0.9975 




Error (RSE) 





Degrees of 
Freedom (n-k) 

71 





Table 3: Markov Model with COD support and SF 


4. Incorporating Cannibalization 

Cannibalization is the practice of removing “good” components from one NMC 
aircraft to return another NMC aircraft to a MC status. While cannibalization can 
improve readiness, it is frowned upon in practice. Each NMC aircraft represents an 
opportunity to cannibalize good parts to repair other NMC aircraft. To capture the 
cannibalization opportunity explanatory variable CANN t is added to the function for P 2 
where CANN, is equal to the number of NMC aircraft on a given day. The fit of this 
model is described in detail in the next section. 

Another hypothesis examines the possibility that the number of aircraft that start 
the day in a NMC status affects the number of aircraft that fail during the day. The idea 
behind the effect is twofold: cannibalizations may be used to return an aircraft to a MC 
status before it is reported as NMC, or as the readiness approaches the goal, maintenance 
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personnel are more aggressive in the repair effort. However, inclusion of the explanatory 
variable CANN, in the function for Pi did not improve the fit. 


D. THE FINAL MODEL 


The final criteria are rather judgmental on the part of the author: “Does the model 
capture the underlying process?” Deciding this involves checking the parameter 
estimates to ensure changes in the explanatory variables have the expected impact. 

The model selected captures three aspects of the underlying process: aircraft 
operating environment estimated by the number of sorties flown, “off ship” logistics 
support estimated by the number of days since the last “off ship” support, and 
cannibalization opportunities estimated by the number of down aircraft. The final model 
is 


E[MC t+l \MC,) = 


exp(2.8686 - 0.2075*5F t+1 ) ] + 

(l + exp(2.8686-0.2075 *SF, +1 ))J 


exp(-0.6924* COD. + 0.0S56* CANN,) 1 

- > *NMC t 

(1 + exp(-0.6924 * COD, + 0.0856 * CANN ,)) J 


(13) 


Table 3 lists the model statistics including the 90% confidence levels for the parameters. 
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Variable Name 

Parameter 

Standard 

90% Cl 


Estimate 

Error 

LL 

UL 

Po (Pi Intercept) 

2.8686 

0.1970 

2.5733 

3.2458 

Pi (Pi SF) 

-0.2075 

0.1261 

-0.4392 

-0.0058 

<j>, (P 2 , cod) 

-0.6924 

0.2697 

-1.2210 

-0.2989 

<|> 2 (P 2 , CANN) 

0.0856 

0.0476 

0.0139 

0.1711 

Residual Sum of 

66.7639 




Squares (RSS) 
Residual Standard 

0.9739 




Error (RSE) 
Degrees of 
Freedom (n-k) 

70 





Table 4: Final Markov Model 


The extra parameter and the explanatory variable CANN t improves the fit over the 
previous model and more importantly it captures the aspect of the underlying process set 
out as a goal for this thesis. A detailed interpretation of the model and parameter 
estimates is provided in Chapter IV. 

E. GENERALIZED LINEAR MODEL 

A family of Generalized Linear Models (GLM) is also fit to the F/A-18 MC 

counts to provide a baseline for comparison with the Markov model. The models are fit 
using the GLM function provided with S-Plus, with a Poisson response variable (MC t ) 
and a log linear link function so that log(E[MC t+ ilMC,]) are modeled as linear in the 
explanatory variables. While the response variable (MC t ) is clearly not Poisson (mean 
does not equal the variance) it captures the counting aspect of the data and fits better than 
the alternative distributions available. Further details of the fitting algorithms are 
available in the S-Plus Guide to Statistics (1997). The fitting process follows the 
standard modeling techniques for GLMs (i.e., McCullagh and Nelder (1983)). The GLM 
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in Table 5 is fit with the same explanatory variables fit during the Markov modeling 


process. 


Variable Name 

Parameter 

Estimate 

Standard 

Error 

T value 

Po (Intercept) 

2.9667 

0.5363 

5.5320 

Pi(MC t ) 

0.0147 

0.01814 

0.8122 

P2(SF, +1 ) 

-0.0003 

0.0002 

-0.4311 

P 3 (cod,) 

-0.0193 

0.0066 

-0.2466 


Table 5: GLM with MC„ SF, +] and cod, 


A generalized likelihood ratio test is used to test the null hypothesis: 
E[MC, +1 IMC,] = /? 0 (14) 

against the alternative model ' • 

E [MC, +1 IMCJ = /3 0 +AMC t +/3 2 SF t+l + p 3 cod t . (15) 

The generalized ratio test gives a p-value of 0.1994 (The test statistic is 1.0029 which 
under the null hypothesis has an approximate j 2 with three degrees of freedom 
distribution). Thus, we fail to reject the null hypothesis and conclude that the alternate 
model with explanatory variables MC,+i, SF t+ i, and cod, does not significantly improve 
the fit over the null model. Parameter estimates for the alternative are given in Table 5. 
Difficulty in finding significant classic regression models that provide good forecasts is 
also found in both Junor (1998) and Moore (1998). For this data set, the Markov model 
not only performs better than classic regression models it is the only formulation tested 
that worked with the data provided. 
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IV. FORECASTING WITH MARKOV MODELS 

This chapter begins with an interpretation of the parameter estimates for the 
Markov model and examines the effect of changes in the explanatory variables have on 
forecasted readiness. The Markov model is used to successfully forecast the final twelve 
days of the INDEPENDENCE’S deployment. Finally, the Markov model is used to assess 
the effect of a prolonged deprivation of COD service on F/A-18 readiness. 

A. REVIEW OF PARAMETER ESTIMATES 

Sorties flown are included as an explanatory variable in the function for Pi. In 
Table 6, the impact of changing aircraft utilization rates is examined. Specifically, this 
involves varying the number of sorties flown per MC aircraft. As expected, as the 
number of SF increases, the probability that MC aircraft remain MC decreases. The final 
column examines the impact of the number of SF on MC SS , the long run mean of the 
unconditional distribution of MC t +i. 


Value of “SF l+ ,” 

Pi 

MC SS 

0.0 

0.9463 

91.59 

1.0 

0.9347 

89.95 

2.0 

0.9209 

88.08 

3.0 

0.9044 

85.95 


Table 6: Impact of SF 

In the final Markov model the function for P 2 includes two explanatory variables, 
cod t and CANN t . To isolate the effect changes in one of the explanatory variables has on 
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P 2 , the other is held constant at the value observed most often in the INDEPENDENCE 


data set. 

Table 7 presents the change in the P 2 while the value of cod t is varied and the 
value of CANN, is held constant at four, which is approximately the average number of 
NMC aircraft observed on a day-by-day basis. COD support has a significant negative 
impact on the probability an aircraft is repaired. To provide a more intuitive measure of 
what a change in the probability of repairing an aircraft has, consider an individual 
aircraft. By definition each day at 1200 local NMC aircraft are subject to a Bemouli trial. 
The number of Bernoulli .trials that must be conducted before the first success (a 
transition from NMC to MC) is a Negative Binomial random variable with parameter P 2 
and an expected value of 1/ P 2 (Larson, 1994). Since the status of aircraft is determined 
only once each day there is a one to one conversion from the expected number of trials to 
the number of days a NMC aircraft can be expected to remain NMC. The model predicts 
that small increases in the average number of days between CODs will have a significant 
effect on aircraft repair turn around time. 


Days since last COD 

p 2 

Days to Repair 

0 

0.5846 

1.71 

1 

0.4135 

2.14 

2 

0.2610 

3.83 

3 

0.1502 

6.65 


Table 7: Impact of COD support ' 

Table 8 examines the impact of the cannibalization opportunity represented by 
number of NMC aircraft. In this table, COD support is assumed and the value of cod t is 




held constant at zero, implying “daily COD support”. It is clear the availability of COD 
support outweighs the cannibalization opportunities presented by additional down 
aircraft. During the. deployment, INDEPENDENCE never went more than four days 
without COD service. Frequent access to “off ship” logistics support reduces the need to 
cannibalize aircraft to maintain readiness above CNO goals. If the frequency of COD 
service is reduced, or COD service is interrupted for a prolonged period of time, it can be 
anticipated that the number of cannibalizations would increase and the magnitude of the 
parameter for cod t would increase as well. 


Number of NMC aircraft 

P 2 

Days to Repair 

3 

0.5637 

1.77 

4 


1.71 

5 

0.6052 

1.65 

6 

0.6253 

1,59 


Table 8: Cannibalization 


This Markov model does not capture onboard supply support elements. Much of 
this has to do with its one day forecast horizon. It can be argued that the aggregate 
measures normally monitored for onboard supply position do not change significantly 
overnight making inclusion of such variables of - little use in short-term forecasting. 
However, a Markov model with longer planning horizons may be able to incorporate 
these measures. Inclusion of aggregate supply measures may never provide the resolution 
modelers seek in readiness models. It is more likely that the lack of specific components 
has a much greater predictive capacity than general measures such as range and depth of 
onboard spares. 
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One of the problems identified earlier in the INDEPENDENCE F/A-18 readiness 
data is underdispersion. Because the data is underdispersed there is not enough 
explainable variation to allow inclusion of as many explanatory variables as desired. One 
possible explanation for the underdispersion is the fact that not every MC aircraft flies on 
a given day. While some of the aircraft that do not fly transition to NMC as a result of 
discrepancies discovered during routine preventive maintenance, it is likely that some of 
the aircraft are not “tested” for failure at all. Thus, the parameter N in the Binomial 
distribution is too large, which leads the model to expect more variance than is present. 

B. FORECASTING 

The last twelve MC observations are retained to check the forecasting ability of 
the Markov model. Figure 4 starts with the MC counts for the 120 days 
INDEPENDENCE was in the Persian Gulf. The gaps in the counts are inport periods 
when MC counts are only recorded on Wednesdays. Fitted values are provided for the 
period used to estimate model parameters. Notice that fitted values start one day after the 
ship returns to sea because the model needs MC, to predict MC,+i. If the model were 
implemented onboard ship the MC, would be known the day before the ship pulled out 
and fitted or forecasted values could be produced for those days. 

Finally one-step forecasts from the Markov model are plotted against the observed 
counts for the last twelve days of the deployment. Overall the model performs very well, 

I * ' 

and the RSS for the 12 forecasts is less than 0.5 aircraft per day. 
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F/A-18 Markov Model 



Figure 4: Fitted and Forecast MC Counts for the Markov Model 
Of note on Figure 4, is May 10 th . On that day the number of mission capable 

aircraft fell from 29 to 23. This change exceeds all others and warrants a closer 
examination. A review of the explanatory variables indicates nothing unusual about the 
day. However, discussion with INDEPENDENCE revealed the following: F/A-18 
aircraft have sophisticated equipment that monitors the stress level placed on the aircraft 
during takeoff, flight, and landing. If certain stress levels are exceeded, the aircraft is 
subjected to a series of conditional inspections that must be completed before it can be 
returned to service. On May 9, three F/A-18 aircraft experienced what is called “hard 
lan din g,” that is, their sensors detected the aircraft impacted the deck too hard during 
landing. All three aircraft were reported NMC on May 10 th while technicians completed 
the conditional inspections. 
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C. PREDICTING THE IMPACT OF A LOSS OF "OFF SHIP" LOGISTICS 
SUPPORT 

Carrier Air Wings enjoy “off ship” logistics support an average of every 1.2 days 
while deployed. INDEPENDENCE averaged “off ship” logistics support every 1.38, 
with the longest period of independent operations being four days. 


Forecast F/A18 Readiness 



Figure 5: Forecasts for Prolonged Period of COD deprivation 

To predict F/A-18 readiness in the absence of “off ship” logistics support, MC SS is 
used to display the expected change in the unconditional mean of the process. The 
variable cod t = 0,1,2,. ..,15 was used with two flying profiles, 15 and 58 sorties per day to 
represent both low and high aircraft utilization rates. The variable CANN t was updated 
each day using the expected value from the previous day. Here the model predicts that 
the MC SS rate falls below the CNO goal in five to eight days depending on aircraft 
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utilization rate. This result is in line with the intuition of personnel on 
INDEPENDENCE. 

In the model, the impact of a prolonged deprivation of COD service virtually 
precludes repair of NCM aircraft after six days. This is not the case in practice, as aircraft 
would continue to be repaired at some reduced rate. One possible extension of the model 
would be to subdivide NMC aircraft into two categories: NMC supply (NMCS), i.e., an 
aircraft is down awaiting parts from an “off ship” source; and NMC maintenance 
(NMCM), i.e., an aircraft is down awaiting the attention of maintenance personnel. 
Because this model combines these two classifications, the explanatory variable COD 
affects the rate at which aircraft are returned from both NMCM and NMCS. In practice, 
cannibalization and innovative maintenance would allow more aircraft to be repaired 
onboard during the COD outage than is currently reflected in the model. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


CTF-50 and INDEPENDENCE asked NPS to provide assistance in analyzing the 
effect of changes in the frequency of COD service on carrier based aircraft readiness. 
This thesis develops a non-linear model based on a modified Markov chain, which adds 
realism to the model that classic regression cannot. Empirical results indicate that 
significant parameters found with a Markov approach provide better forecasts than those 
obtained using classic regression techniques. 

The Markov approach indicates a significant link between the frequency of COD 
service and cannibalization opportunity to the probability an aircraft is repaired. 
Additionally, it shows a significant link between aircraft utilization rate and the 
probability an aircraft fails. By appealing to stochastic queuing theory, aircraft mean time 
between reported failures and mean time to repair could be estimated. 

The model estimates that INDEPENDENCE can expect to go five to eight days 
without “off ship” logistics support before F/A-18 readiness falls below the CNO goal. 
The number of days is sensitive to aircraft utilization rate with higher utilization rates 
reducing the estimated number of days. 

While the model includes a term to capture cannibalization, its effect is not as 
large as expected. That is, cannibalization did not significantly reduce the effect of a 
long-term COD deprivation. The effect modeled here can most likely be attributed to 
increased pressure on maintenance personnel to maintain MC rates above CNO goals as 
the number of NMC aircraft increases. In a wartime scenario, or a period where a 
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prolonged outage of “off ship” logistic support is anticipated, cannibalizations would 
increase and maintenance personnel would be more aggressive in the repair effort, which 
would likely extend the number of days readiness rates would remain above CNO goals. 

Areas for further research include refinement of the data collection to improve 
model predictions. This could include expansion of the basic Markov model to treat 
aircraft down for maintenance (NMCM) differently than aircraft down for parts (NMCS) 
which may well lead to more accurate estimates of aircraft readiness. Another potential 
area is the use of the Markov framework to simulate the effects of prolonged deprivation 
of “off ship” logistics support on carrier based aviation readiness. One interesting side 
effect of using a Markov model is the fact that the parameter estimates are easily 
transformed into transition probabilities; this lends itself to simulation. 

The ability to transmit data over the Internet from the carrier to shore based 
activities enables near real time analysis of readiness. Establishing this data link enables 
shore based analysts to augment onboard analysis efforts thereby giving the deployed 
decision maker better information on which to make management decisions. 
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